Experimental evidence on learning using low-tech when school is out.

School closures occurred extensively during the COVID-19 pandemic, and occur in other settings, such as teacher strikes and natural disasters. The cost of school closures has proven to be substantial, particularly for households of lower socioeconomic status, but little evidence exists on how to mitigate these learning losses. This paper provides experimental evidence on strategies to support learning when schools close. We conduct a large-scale randomized trial testing two low-technology interventions-SMS messages and phone calls-with parents to support their child in Botswana. The combined treatment improves learning by 0.12 standard deviations, which translates to 0.89 standard deviations of learning per US$100, ranking among the most cost-effective interventions to improve learning. We develop remote assessment innovations, which show robust learning outcomes. Our findings have immediate policy relevance and long-run implications for the role of technology and parents to support education provision during school disruptions.

School’s Out: Experimental Evidence on Limiting Learning Loss Using “Low-Tech” in a Pandemic

Schools closed extensively during the COVID-19 pandemic and occur in other settings, such as teacher strikes and natural disasters. This paper provides some of the first experimental evidence on strategies to minimize learning loss when schools close. We run a randomized trial of low-technology interventions – SMS messages and phone calls – with parents to support their child. The combined treatment cost-effectively improves learning by 0.12 standard deviations. We develop remote assessment innovations, which show robust learning outcomes. Our findings have immediate policy relevance and long-run implications for the role of technology and parents as partial educational substitutes when schooling is disrupted.

Government responses and COVID-19 deaths: Global evidence across multiple pandemic waves.

We provide an assessment of the impact of government closure and containment measures on deaths from COVID-19 across sequential waves of the COVID-19 pandemic globally. Daily data was collected on a range of containment and closure policies for 186 countries from January 1, 2020 until March 11th, 2021. These data were combined into an aggregate stringency index (SI) score for each country on each day (range: 0-100). Countries were divided into successive waves via a mathematical algorithm to identify peaks and troughs of disease. Within our period of analysis, 63 countries experienced at least one wave, 40 countries experienced two waves, and 10 countries saw three waves, as defined by our approach. Within each wave, regression was used to assess the relationship between the strength of government stringency and subsequent deaths related to COVID-19 with a number of controls for time and country-specific demographic, health system, and economic characteristics. Across the full period of our analysis and 113 countries, an increase of 10 points on the SI was linked to 6 percentage points (P < 0.001, 95% CI = [5%, 7%]) lower average daily deaths. In the first wave, in countries that ultimately experiences 3 waves of the pandemic to date, ten additional points on the SI resulted in lower average daily deaths by 21 percentage points (P < .001, 95% CI = [8%, 16%]). This effect was sustained in the third wave with reductions in deaths of 28 percentage points (P < .001, 95% CI = [13%, 21%]). Moreover, interaction effects show that government policies were effective in reducing deaths in all waves in all groups of countries. These findings highlight the enduring importance of non-pharmaceutical responses to COVID-19 over time.

Building back better to avert a learning catastrophe: Estimating learning loss from COVID-19 school shutdowns in Africa and facilitating short-term and long-term learning recovery

We model learning losses due to the COVID-19 pandemic and the potential for cost-effective strategies to build back better. Data from Early Grade Reading Assessments in Ethiopia, Kenya, Liberia, Tanzania, and Uganda suggest half to over a year’s worth of learning loss. In modeling losses over time, we found that learning deficits for a child in grade 3 could lead to 2.8 years of lost learning by grade 10. While COVID-19 has stymied learning, bold, learning-focused reform consistent with the literature reviewed in this paper—specifically reform on targeted instruction and structured pedagogy—could improve learning even beyond pre-COVID-19 levels.

A global panel database of pandemic policies (Oxford COVID-19 Government Response Tracker).

COVID-19 has prompted unprecedented government action around the world. We introduce the Oxford COVID-19 Government Response Tracker (OxCGRT), a dataset that addresses the need for continuously updated, readily usable and comparable information on policy measures. From 1 January 2020, the data capture government policies related to closure and containment, health and economic policy for more than 180 countries, plus several countries' subnational jurisdictions. Policy responses are recorded on ordinal or continuous scales for 19 policy areas, capturing variation in degree of response. We present two motivating applications of the data, highlighting patterns in the timing of policy adoption and subsequent policy easing and reimposition, and illustrating how the data can be combined with behavioural and epidemiological indicators. This database enables researchers and policymakers to explore the empirical effects of policy responses on the spread of COVID-19 cases and deaths, as well as on economic and social welfare.

Practical lessons for phone-based assessments of learning.

School closures affecting more than 1.5 billion children are designed to prevent the spread of current public health risks from the COVID-19 pandemic, but they simultaneously introduce new short-term and long-term health risks through lost education. Measuring these effects in real time is critical to inform effective public health responses, and remote phone-based approaches are one of the only viable options with extreme social distancing in place. However, both the health and education literature are sparse on guidance for phone-based assessments. In this article, we draw on our pilot testing of phone-based assessments in Botswana, along with the existing literature on oral testing of reading and mathematics, to propose a series of preliminary practical lessons to guide researchers and service providers as they try phone-based learning assessments. We provide preliminary evidence that phone-based assessments can accurately capture basic numeracy skills. We provide guidance to help teams (1) ensure that children are not put at risk, (2) test the reliability and validity of phone-based measures, (3) use simple instructions and practice items to ensure the assessment is focused on the target skill, not general language and test-taking skills, (4) adapt the items from oral assessments that will be most effective in phone-based assessments, (5) keep assessments brief while still gathering meaningful learning data, (6) use effective strategies to encourage respondents to pick up the phone, (7) build rapport with adult caregivers and youth respondents, (8) choose the most cost-effective medium and (9) account for potential bias in samples.